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ABSTRACT 

Observations of atmospheric neutrinos by the SuperKamiokande collab- 
oration have demonstrated large mixing of the muon-neutrino. However the 
present atmospheric neutrino data does not significantly constrain the as- 
sociated mixing of the electron-neutrino, or the sign of the mass-squared 
difference. Here we identify the diagnostics for these quantities and they also 
test the theory of how matter affects neutrino oscillations. These diagnostics 
are a dip in the sub-GeV muon flux at a zenith angle of 110 degrees, a bump 
in the electron up-down asymmetry at multi-GeV energies and a bump in 
the muon-antimuon upward asymmetry. 
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Neutrinos produced in the atmosphere by cosmic rays have been ob- 
served by several underground neutrino detectors [1] These measure- 
ments have long suggested new neutrino physics 0, and this has been con- 
clusively demonstrated by recent data. SuperKamiokande [jXJ] has observed a 
deficit of muon-neutrinos at large zenith angles while the electron-neutrino 
(z/ e ) flux is as expected. These results are well explained by large mixing 
between the muon-neutrino (z/^) and the tau-neutrino {u T ) [|J. 

To interpret the atmospheric neutrino observations, we work in a frame- 
work using all three neutrino types ||. Three neutrino mixing depends on two 
mass-squared difference scales, three mixing angles and a phase — however not 
all of these parameters are relevant for atmospheric neutrinos. The several 
solar neutrino observations || suggest neutrino mixing also occurs on a scale 
below what can be resolved by the measurements of atmospheric neutrinos. 
So for atmospheric neutrino analyses the smallest mass-squared difference can 
be neglected, which then renders one mixing angle and the phase unobserv- 
able. The resulting framework has been used many times to find constraints 
on the neutrino mixing parameters from the Kamiokande results [[?]]- 1| and 



also now the preliminary SuperKamiokande results [10|. Here we adopt a dif- 



ferent approach |TT| than these latter references. We strive to qualitatively 
understand the present data, and to use this understanding to determine 
which measurements are most important. 

The primary motivation for this work is to find the best way to extract 
the v e mixing parameter from the atmospheric neutrino data. Binning the 
data as theory suggests can enhance the statistical significance of a signal, 
and hence increase the sensitivity to v e mixing. Also, a believable demon- 



stration of nonzero u e mixing will require a clear, unambiguous diagnostic. 
The u e mixing is not a dominant feature in the current data, but it is an 
especially interesting parameter. It will help determine what level of sensi- 
tivity is needed by next generation double beta-decay experiments in order to 
test if neutrinos are majorana or dirac fermions. The u e mixing at the atmo- 
spheric scale is also necessary to interpret the solar neutrino measurements 
[ O] . Constraints on u e mixing near the atmospheric scale have recently been 
placed by the CHOOZ long-baseline reactor neutrino experiment fl3| and will 
be placed by the long-base line accelerator experiments (MINOS and K2K 
[PI]) which are presently under construction. However these experiments 
may not be able to probe small enough mass scales. Even if they do observe 
some neutrino mixing effects, they are relatively insensitive to neutrino for- 



ward scattering off of the electron background [15] of the Earth. The sign of 
the neutrino mass-squared difference parameter can not be observed without 
both v e mixing and matter effects. We shall show that matter effects are cru- 
cial to discerning the v e mixing from the atmospheric neutrino observations. 
Thus these observations test how the matter background affects neutrino 
mixing. This is important because neutrino forward scattering effects have 
never been observed before, but they are heavily used in interpretations of 
solar neutrino observations. 

The parameterization of the mixing 

\v a > = U ai \vi > (1) 

between the flavor eigenstates, a = e, fi, r, and the mass eigenstates, % = 
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1,2,3, is here chosen to be 



U 



(2) 



cos <f> sin (f) 

— sin if) sin (f> — cos if) sin ip cos 

— cos ip sin sin ip cos -0 cos <p 

where the angles and ip range from to tt/2, and the single mass-squared 
difference scale, A, can be positive or negative. This parameterization is 



the convention used in Ref. [ 12fl , it was developed so that matter effects 



|fLq1 are straightforward. The oscillation amplitudes depend on the matter 
background. For arbitrary matter distributions, the amplitude for oscillations 
from u a to Up can be written as 



Amp 



cos ipB xe 
smip cos ip{B xx — 1) 
cos 2 ipB xx + sin 2 ip 
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B ee sin ipB xe 

, .,(3 = sin ipB ex cos 2 if} + sin 2 if>B xx 
cos ip B ex sin if> cos if> (B xx — 1) 

Here the S's are the conventional amplitudes for oscillations in the 'standard' 
two-flavor approximation and satisfy the usual unitarity constraints: |-B ee | 2 = 
I -Bxx 1 2 — 1 — \B ex \ 2 . They include all of the matter effects and the only 
mixing parameter they depends on is <f>. Note that the B's are different for 
neutrinos and antineutrinos. We see that the three-neutrino, one mass scale 
approximation reduces to v e <-> v T oscillations in the limit sin^ — ■> 0, to 
v e *^ v n oscillations in the limit sin?/' — > 1, and to <-> v T oscillations in the 
limit B ex — > 0. Explicit expressions for the oscillation probabilities in this 
framework for a constant density background can be found in Ref. 0. 

The detectors observe the electrons and muons produced by the atmo- 
spheric neutrinos. The ratio of the observed to expected charged lepton fluxes 



produced by neutrinos are given by 




(4) 



where 



e = (r sin 2 ip — 1)\B, 



ex 
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(5) 



The expected ratio of the fluxes without oscillations is here denoted by r = 
N®/N®. r varies somewhat with energy and zenith angle, 9, but typically 



by fi^ — > e ± + + v e . The observation of a deficit of atmospheric at 
large zenith angle while the v e flux is as expected can both be explained by 
large £ z^ — z/ T ' mixing, i.e. ip 7r/4. This is because the oscillatory term 
Re(B xx ) is one for short propagation distances but averages to zero at large 
propagation distances, while a cancellation produces a naturally small value 
for e. A crude, heuristic explanation of this cancellation in e is possible. 
Without mixing there are expected to be twice as many as their are i/ e 's, 
however when 'z/^ — i/ T ' mixing is maximal only half of the z/^'s are left to 
mix with the z/ e 's. This leaves equal numbers of and z/ e 's so the l u e — 
mixing is difficult to detect. Thus the gross features of the SuperKamiokande 
atmospheric neutrino data do not strongly constrain the \B ex \^ factor in e or, 
consequently, the mixing parameter. 

To diagnose the mixing with u e , we consider independently three classes 
of atmospheric neutrino data: the sub-Gev contained events, the multi-GeV 
events, and the 'high' energy through going muons (which have an average 



it is about 2 since the neutrinos are produced by tx 



± 



J u ± + followed 
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energy of about 100 GeV). The energy scale for the oscillations amplitudes 
is given by 

/2.0#/cm 3 \ / A \ 

E man tle « 6.7GeV - 2 

\ Y e p J \2 x 10~ 3 eVV 

E C ore ~ 0.4£/ man f; e (6) 

where y e is the number of electrons per nucleon, and p is the density. Note 
that neutrinos propagate through the core only at very large zenith angles, 
when cos(#) < —0.84. The behavior of the oscillation amplitude is qualita- 
tively different in the three energy regimes. 



Sub- GeV neutrinos. Here r fa 2 for all zenith angles |16|. Taking ip fa 7r/4, 
as suggested by the observations, then the e terms can be neglected because 
they are suppressed by the cancellation. The dominant effect of u e mixing is 
in the muon data! For a constant density, 

l r 2 , _ / A \ /0.5GeV\ / t 



i' 



--[1 + COS 2 0COS(27T n — . 

N® 2 L ^ v V2xlO- 3 eV 2 A E J V 620km 



+ sin 2 0cos(2 7 rf^^V-4-) ( os^ )) ] (7) 



F e p / V 8300km, 

for neutrinos and antineutrinos. This expression contains two oscillatory 
terms which are quite different. The first is the 'usual' two-flavor vacuum 
oscillations while the second is a three-flavor effect which results because the 
matter background splits the degeneracy between the lightest neutrino states 
[0] [0. Detection of the matter induced oscillations would indicate mixing 
with the v e . 

The vacuum oscillations affect the angular distribution of sub-GeV neu- 
trinos near the horizon, while 'matter oscillations' affect neutrinos in the 
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lower hemisphere. To suppress the former, and to statistically enhance the 
resolution of the latter, it is natural to sum over all sub-GeV energies. Fig. 
(1) shows the expected distortions in the zenith angle distribution of the sub- 
GeV muon data, with and without v e mixing. The angular resolutions of the 
Super Kamiokande and Soudanll detectors have been used. The most promi- 
nent effect of v e mixing is the dip in the flux where the matter oscillation term 
has its first minimum, at cos# ~ (—0.32/ cos 2 0). The higher densities in the 
core act to increase the matter oscillation phase and hence angular smear- 
ing suppresses the matter oscillations at the very largest zenith angles. The 
angular resolution possible in a fine grained detector like Soudanll, which 
can observe some of the nuclear recoil particles, appears to be necessary to 
resolve the matter oscillations. A future, larger, fine-grained atmospheric 
neutrino detector may be able to observe this signal. The present sub-GeV 
data does not constrain the u e mixing parameter 0. 

Geomagnetic effects will complicate the resolution of this matter effect 
since they produce asymmetric angular variations in the neutrino flux. How- 
ever the different effects can be disentangled, in principle, since the matter 
oscillation is energy independent, independent of azimuthal angle, and the 
same for all detector sites, while the geomagnetic effect is not. There is only 
one free parameter that describes the size and location of the dip produced 
by matter oscillations, the u e mixing angle <fi. 

Multi-GeV neutrinos. For nonzero v e mixing (0 ^ 0), there is a two- 



flavor resonance |L5| with the matter background at the energy in Eq. (y). 
To resolve this energy dependent effect, it is natural to enhance statistics 
by summing over zenith angle to form the up-down asymmetries The 
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electron asymmetry may now show a signal because the cancellation in e 
may no longer be complete since at multi-GeV energies r is considerably 
larger than 2 for cos 8 « ±1, and because \B ex \ 2 « 0.5 for neutrinos (or 
antineutrinos) with energies near E mant i e . The curves in Fig. (2) shows the 
electron up-down asymmetry, A e = (U — D)/(U+D), as a function of energy, 
for the angular resolution of SuperKamiokande. The v e mixing generally 
causes a positive bump at the resonance energy. However the size of this 
bump is quite sensitive to the precise value of if). A chi-squared fit to this 
SuperKamiokande data shows that the multi-GeV data does not significantly 
constrain the the v e mixing parameter for the values of A and if> allowed 
by the SuperKamiokande data. However some constraints may be possible 
with higher statistics, and a close examination of systematic errors (such as 
particle misidentification) at the high energy end of the multi-GeV electron 
up-down asymmetry data. 

The effects of v e mixing and matter are more difficult to observe in the 
'usual' multi-GeV muon up-down asymmetry. This is because the muon 
asymmetry already has large distortions from the large V M — z/ T ' vacuum os- 
cillations, and because the oscillatory terms in Eq. (|7]) tend to be suppressed 
near resonance energies by energy and angular smearing. However if multi- 
GeV muon's and antimuon's can be discriminated in SuperKamiokande |L7| 



or a future atmospheric neutrino detector, this would provide an especially 
interesting, additional diagnostic. 

The asymmetry between muons and antimuons in the upward fluxes 
A^-p = {{UJD^) - (U-jD^KiUjD^) + (Up/Dp)), would show a bump 
at the resonance energy. The size of the bump in A^-p is comparable to the 



size of the bump in A e . The bump is produced by v e mixing and matter 
effects. is particularly interesting because it is especially sensitive to 

the sign of the neutrino mass-squared parameter, A. Flipping the sign of 
A does not affect the sub-GeV diagnostic at all, it reduces the size of the 
bump in the multi-GeV electron up-down asymmetry by 40%, but it flips the 
sign of the bump in the muon-antimuon asymmetry. A is positive if neutri- 
nos have a mass heirarchy similar to the charged leptons, but this must be 
experimentally determined. 

'High' energy neutrinos. For E manUe « E, matter effect suppress all 
trace of mixing with the v e . The leading term in the two flavor amplitude 
vanishes as 



for neutrinos and antineutrinos. In this energy regime, the three-flavor frame- 
work reduces exactly to the 'usual' two- flavor 'is^ — vacuum oscillation ex- 
pression. Thus the through going muon data at SuperKamiokande, MACRO, 
AMANDA, etc. is completely insensitive to the mixing with v e . 



I would like to thank T.K. Kuo, J. Learned and S. Pakvasa for useful 
discussions. This work is supported in part by Research Corporation. 





Acknowledgements 



9 



References 



[1] Super-Kamiokande Coll., Y. Fukuda et al., |hep-ex/9803003| , [hep 



ex/9805006 



[2] Kamiokande Coll., K.S. Hirata et al., Phys. Lett. B 205, 416 (1988); 
Phys. Lett. B 280, 146 (1992); 1MB Coll., R. Becker-Szendy et al., 
Phys. Rev. D 46, 3720 (1992); D. Casper et al., Phys. Rev. Lett. 66, 
2561 (1991); Soudan II Coll., W.W.M. Allison et. AL, Phys. Lett. B 
391, 491 (1997). 

[3] J.G. Learned, S. Pakvasa and T.J. Weiler, Phys. Lett. B 207, 79 (1988); 
V. Barger and K. Whisnant, Phys. Lett. B 209, 365 (1988); K. Hidaka 
et al., Phys. Rev. Lett. 61, 1537 (1988). 



[4] Super-Kamiokande Coll., Y. Fukuda et al., |hep-ex/9807003 



[5] This framework is incompatible with the observations of neutrino mix- 
ing by the LSND short baseline experiment, C. Athanassopoulos et al, 
Phys. Rev. Lett. 75, 2650 (1995). However the experimental evidence 
from LSND is weak, especially in light of the preliminary results from 
KARMEN, talk by B. Zeitnitz at Neutrino-98, Takayama, Japan, June 
1998. 

[6] Super-Kamiokande Coll., talk by Y. Suzuki at Neutrino-98, Takayama, 
Japan, June 1998; B.T. Cleveland et al, Nucl. Phys. B (Proc. Suppl.) 
38, 47 (1995); Kamiokande collaboration, Y. Fukuda et al, Phys. Rev. 
Lett., 77, 1683 (1996); GALLEX Coll., W. Hampel et al, Phys. Lett. 



10 



B388, 384 (1996); SAGE Coll., J.N. Abdurashitov et ai, Phys. Rev. 
Lett. 77, 4708 (1996). 

[7] J. Pantaleone, Phys. Rev. D 49, 2152 (1994); J. Pantaleone, Phys. Lett. 
B 292, 201 (1992). N.B. the mixing convention in the current paper is 
identical to these references, except that the labels on the 1 and 2 mass 
eigenstate are interchanged. 

[8] S. Midorikawa, M. Honda, K. Kasahara, Phys. Rev. D 44, 3379 (1991); 
C.Y. Cardall and G.M. Fuller, Phys. Rev. D 53, 4421 (1996); M. 
Narayan, G. Rajasekaran, S.Uma Sankar, Phys. Rev. D 56, 437 (1997). 

[9] G.L. Fogli, E. Lisi, D. Montanino, and G. Scioscia, Phys. Rev. D 55, 
4385 (1997); C. Giunti, C.W. Kim, M. Monteno, Nucl.Phys. B 521, 3, 
(1998). 



[10] O. Yasuda, |hep-ph/9804400| ; T. Teshima and T. Sakai, |hep-ph/9805386| ; 



V. Barger, T.J. Weiler, and K. Whisnant, [hep-ph/98073~T9| . 



[11] J.W. Flanagan, J.G. Learned, and S. Pakvasa, Phys. Rev. D 57, 2649 
(1998). 

[12] T.K. Kuo and J. Pantaleone, Rev. Mod. Phys. 61, 937 (1989). 

[13] CHOOZ Coll. M. Apollonio et al, Phys. Lett. B 420, 397 (1998). 

[14] MINOS Coll., "Neutrino Oscillation Physics at Fermilab: The NuMI- 
MINOS Project", NuMI-L-375, May (1998); K2K Coll., K. Nishikawa, 
talk at Neutrino-98, Takayama, Japan, June 1998. 



11 



[15] L. Wolfenstein, Phys. Rev. D 17, 2369 (1978); D 20, 2634 (1979); S. P. 
Mikheyev and A. Yu Smirnov, Yad. Fiz. 42, 1441 (1985) [Sov. J. Nucl. 
Phys. 42, 913 (1985)]; Nuovo Cim. C 9, 17 (1986). 

[16] M. Honda, T. Kajita, K. Kasahara and S. Midorikawa, Phys. Rev. D 52 
4985 (1995); V. Agrawal, T.K. Gaisser, P. Lipari and T. Stanev, Phys. 
Rev. D 53, 1314 (1996). 



[17] J.M. LoSecco, |hep-ph/98063T8 



12 



FIGURE CAPTION 



Fig. 1. The sub-GeV muon flux (N^/N®) as a function of zenith an- 
gle. Points with error bars are current experimental measurements and 
curves show expected distributions, where circle (triangle) markers denote 
Super Kamiokande []J (Soudan II [§]) quantities. The mixing parameters for 
the curves are compatible with limits from CHOOZ and SuperKamiokande, 
A = 1 x 10 -3 , ip = 7r/4 and = (lines with markers), and <fi = 0.50 (lines 
without markers). 

Fig. 2. Up-down electron asymmetry as a function of energy. Points with 
error bars are current SuperKamiokande M measurements, the thick (thin) 
curve shows the expected distribution for A = 2 x 10~ 3 , ip = tt/4 (i/j = it/ 5.5) 
and = 0.25 (compatible with limits from CHOOZ and SuperKamiokande). 
The SuperKamiokande angular resolution has been assumed. 
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Sub-GeV muons. 

SuperK = circles, Soudanll = triangles 




Electron Asymmetry 




